Specialized sensors and techniques for monitoring personal activity

ABSTRACT

New activity recognition, recording, analysis and control techniques, systems and sensors are provided. In some aspects of the invention, multiple sensory tags with unique identification and data transfer attributes, create positional, movement, orientation and acceleration data and supply it to a control system. The tags may be placed at location(s) on the user&#39;s body, clothing, personal effects, exercise equipment and other activity-relevant locations, to enhance activity recognition and mapping. For example, a specialized PDA may comprise part of the control system, and may provide, reflect and/or receive modified data signals to and from such tags. 
     In other aspects, a system defines a personal activity space, samples data preferentially from that space, and performs a simplified form of object-recognition to determine, record and analyze personal activities. 
     A GUI interface within the control system may also aid in recognizing and recording activity patterns, in addition to tags.

COPYRIGHT AND TRADEMARK NOTICE

© Copyright 2013 Christopher V. Beckman. A portion of the disclosure ofthis patent document contains material which is subject to copyrightprotection. The copyright owner has no objection to the facsimilereproduction by anyone of the patent document or the patent disclosure,as it appears in the Patent and Trademark Office patent file or records,but otherwise reserves all copyright rights whatsoever. Unless otherwisestated, all trademarks disclosed in this patent document and otherdistinctive names, emblems, and designs associated with product orservice descriptions, are subject to trademark rights. Specific noticesalso accompany the drawings incorporated in this application; thematerial subject to this notice, however, is not limited to thosedrawings.

FIELD OF THE INVENTION

The present invention relates to the field of sensory devices for usewith computer hardware. The present invention also relates to the fieldof personal area networks and, more specifically, to establishing bothwired and wireless personal area networks.

BACKGROUND

Human beings have implemented purposeful diets, exercise, medicalregimens and other activities and routines (“personal activities”) forcenturies, in an effort to restore, maintain or enhance personal healthand physical performance.

In recent years, research has confirmed that the degree, frequency andtype of personal activities can have profound affects on a person'soverall morbidity and mortality. See, e.g., Brown, W. J et al., Updatingthe Evidence on Physical Activity and Health in Women, Am. J. Prev. Med.33(5): 404-11 (2007). For example, it has long been understood thatsedentary lifestyles are strongly associated with adverse healthconditions and the risk of premature death. Matthews C E et al., Amountof Time Spent in Sedentary Behaviors and Cause-Specific Mortality in USAdults, Am. J. Clin. Nutr.; 95(2): 437-45, Jan. 4, 2012. Flowing fromthis, millions of Americans now attempt to follow the advice of healthprofessionals that they should make an effort to exercise frequently.When provided, a physician's specific advice may vary widely, butguidelines from the Centers for Disease Control recommend: (1) a minimumof 150 minutes of moderate-intensity or 75 minutes of vigorous-intensityaerobic activity, and (2) muscle-strengthening activities on 2 or moredays a week that work all major muscle groups, among other possibleregimen combinations for health benefits. Centers for Disease Controland Prevention, How Much Physical Activity do Adults Need?, available athttp://www.cdc.gov/physicalactivity/everyone/guidelines/adults.html,accessed Jan. 21, 2013.

Strikingly, a majority of patients are still not advised to exercise atall by their physician, even in the face of recent studies establishingthat a majority of adults in the United States are overweight or obese.Patricia M. Barnes, et al., Trends in Adults Receiving a Recommendationfor Exercise or Other Physical Activity From a Physician or Other HealthProfessional, NCHS Data Brief, No. 86 (February 2012); National Centerfor Health Statistics, Health, United States, 2011, at 15 and FIG. 11(Hyattsville, Md., 2012).

In recent years, the sufficiency and soundness of general advice onexercise from health authorities has been called into question byempirical research. Several studies now demonstrate that even a highlevel of regular, moderate-to-vigorous exercise may be insufficient tooffset the destructive effects of time spent sitting. See, e.g.,Matthews C E et al., supra; see also J Lennert Veerman et al.,Television Viewing Time and Reduced Life Expectancy: A Life TableAnalysis, Br. J. Sports Med. 46: 927-930 (2011). Findings like these areextremely important today, because more and more workers in the UnitedStates spend most of their time sitting at work—specifically, whileworking at personal computer terminals. Many of these workers continueto labor under the delusion that, if they spend a half an hour at thegym on a lunch break or after work, they can offset the effects of asedentary work routine. In fact, some studies may even support thedisturbing conclusion that a person may actually be less active,overall, on days that they make an effort to exercise vigorously,offsetting the benefits.

Adherence to medical regimens and compliance with consumption-relatedinstructions from medical and fitness personnel also presentslong-standing, serious challenges for millions. In recent years, aplethora of medical compliance tools (such as reminder systems andcalendared medicine containers) have flourished, but the issue ofcompliance with such regimens continues.

It should be understood that the disclosures in this application relatedto the background of the invention, in, but not limited to this sectiontitled “Background,” do not necessarily set forth prior art or otherknown aspects exclusively, and may instead include art that was inventedconcurrently or after the present invention and conception, and detailsof the inventor's own discoveries and work and work results.

SUMMARY OF THE INVENTION

New personal activity recognition, recording, analysis and controltechniques are provided. Using the system, a user may enhance anexercise, diet and other personal activity regime.

In some aspects of the invention, activity pattern recognition isgreatly improved by a new type of tag- and thermal data-assisted objectrecognition as well as system-wide and location-specific informationsharing. In addition, the system may simplify its analysis by focusingdata gathering into a variably-defined personal activity space. Withrespect to the tag(s), the detectable identity of tags may be assignedby an aspect of the system and/or a user, after which time theiridentity, range and/or more specific location in space relative to auser may be assessed. The presence, position, movement and relevance ofsuch tags is simplified by a unique form of data transfer between tags.

To assist in analyzing, tracking and other related activities, asmartphone, personal digital assistant (“PDA”) or other user-definingsystem aspect with a near-field, tag-pinging or other communicationsub-system identifies relevant tag(s), their location relative to theuser, and contributes that information in aid of defining the user'sactivity patterns. Other activity pattern data contributed to the systemfor activity and activity pattern analysis and recordation arepositional, movement, orientation and acceleration data, which may becontributed by conventional global positioning system (“GPS”),accelerometer and other methods. Activity mapping (including algorithmsapplied by the system for the definition of tagged areas and sub-areasby many different users) may aid the system in identifying and ascribingrelevant environmental and activity qualities to the tags.

In some aspects of the invention, identifying beacons are used, forexample from a local base station defining an environmental area, inaddition to or in place of tags, to aid in area, article and otherenvironmentally-relevant activity definition.

The system may also benefit from implementing local object recognition,benefiting from a new form of thermal differential analysis, to aid inidentifying consumption and other activity. For example, the system mayobtain information relevant to consuming foodstuffs, including thepotential food type, size and caloric properties, among otherconsumption and other activity-relevant data.

Further aspects of the invention and specific embodiments will be setforth below, with reference to the drawings.

Canons of Construction and Definitions

The following terms shall have the following meanings, significance andsenses, in addition to their ordinary and specific meanings,significances and senses in general usage and within the technologicalfield(s) in which they are used.

“GUI,” in addition to its ordinary meaning and special meaning in thearts to which it relates and that may be relevant to this application,means any device, object, method or technique comprising controlsassisting or enabling a user to carry out or affect the performance,actuation, parameters, or other aspects of the invention, or any partthereof. A graphical user interface (“GUI”) comprises, but is notlimited to, virtual controls, or a set thereof, represented by computerhardware and software (for example, actuable visual representations oftools by a computer system on a computer screen).

Where any term is set forth in a sentence, clause or statement(“statement”), each possible meaning, significance and/or sense of anyterm used in this application should be read as if separately,conjunctively and/or alternatively set forth in additional statements,as necessary to exhaust the possible meanings of each such term and eachsuch statement.

It should also be understood that, for convenience and readability, thisapplication may set forth particular pronouns and other linguisticqualifiers of various specific gender and number, but, where thisoccurs, all other logically possible gender and number alternativesshould also be read in as both conjunctive and alternative statements,as if equally, separately set forth therein.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a front perspective view of a user whose activity is beingtracked by an exemplary system implementing aspects of the invention.

FIG. 2 depicts an alternate form of personal activity defining, trackingand analyzing device used in conjunction with a second sensor set, whichmay track one another, in addition to recognizing, defining, trackingand analyzing objects, in aid of personal activity definition andanalysis by a system.

FIG. 3 depicts a personal activity defining, tracking and analyzing basestation, used in conjunction with specialized sensor tags by a system toidentify, define, track and analyze personal activity, in accordancewith aspects of the present invention.

FIG. 4 is an exemplary process flow diagram of exemplary steps that maybe taken by a system, such as (but not limited to) a hardware andsoftware control system, for example, of the nature discussed withreference to FIG. 7, implementing aspects of the present invention.

FIG. 5 is another exemplary process flow diagram of exemplary steps thatmay be taken by a system, such as (but not limited to) a hardware andsoftware control system, for example, of the nature discussed withreference to FIG. 7, implementing aspects of the present invention.

FIG. 6 is another exemplary process flow diagram of exemplary steps thatmay be taken by a system, such as (but not limited to) a hardware andsoftware control system of the nature discussed with reference to FIG.7, implementing additional aspects of the present invention.

FIG. 7 is a schematic block diagram of some elements of an exemplarycontrol system that may be used in accordance with aspects of thepresent invention.

FIG. 8 is a perspective drawing of partially-opened food packagingcontaining several food bars, implementing a nutritional inventory andtracking system according to aspects of the present invention.

FIG. 9 is a perspective drawing of a partially-consumed individual foodbar item, similar to the food bars discussed above, with reference toFIG. 8, and comprising multiple inventory tags and inventory tag typesat spatial intervals throughout the item, which may be used inconjunction with a consumption tracking system according to aspects ofthe present invention, and in accordance with aspects of the presentinvention.

FIG. 10 depicts an exemplary consumable tag, such as the consumable tagsdiscussed above, but also containing a sensor array and sensor-exposingpump/conduit, which may comprise an ion pump/conduit, which may be usedin conjunction with a consumption tracking system according to aspectsof the present invention, and in accordance with aspects of the presentinvention.

FIG. 11 depicts an exemplary consumable tag comprising multiplesignal/response elements, which may interact with one another as well asa control system, in accordance with aspects of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a front perspective view of a user 100 whose activity is beingtracked by an exemplary system implementing aspects of the invention. Aradiation transceiver device 101 is an aspect comprised in that system,and includes a series of additional, sub-aspects. Each aspect may bevariably or permanently networked or otherwise connected and capable ofcommunication with one another and/or other aspects of the system andpresent invention. Such sub-aspects may comprise an antenna 103, capableof both sending and receiving electromagnetic (e.g., microwave) and/orother radiation signals, which may be with the aid of an internal orexternal control system and power source. In some embodiments, receivedradiation (at either antenna 103 or otherwise), or a part thereof, maycomprise the power source but, in others, a battery within device 101provides the power source. In some embodiments, transceiver device 101also may comprise a directional thermometer (such as an infraredthermometer) or pyrometer 105 as a sub-aspect, which may be directedtoward at least a part of the user's body 101, for example, from theside of device 101 facing the user (into the page, in the perspective ofthe figure). Because all sub-aspects may be in communication with thecontrol system, the control system may therefore take readings of theuser's body temperature, which may, in a typical user, be approximately98.2 degrees Fahrenheit, as a mean temperature, and 99.9 degreesFahrenheit as an upper normal limit, although this figure may change(but remain correlated to average core body temperature) depending onthe exact location of the measurements taken, and may also fluctuatethroughout the day. For example, as pictured, if thethermometer/pyrometer 105 takes a reading of cutaneous and/or core bodytemperature from a user's chest, the readings may be significantly lowerthan core body temperature from other readings, but, nonetheless, a corebody temperature may be correlated and extrapolated by the system basedon the user's chest-based temperature data. In some embodiments, thecorrelation may be calibrated based on the mean or floating meandifferential between a separately, substantially simultaneously measuredcore body temperature reading and readings from thermometer/pyrometer105, but readings of great precision may not always be required toimplement aspects of the invention.

Based on extrapolated core body temperatures and/or actual chest and/orcutaneous temperature readings, and in addition to other temperature ortemperature-related radiation (e.g., infrared radiation) readings,aspects of the system may make useful relative temperature comparisonsof nearby objects and the user's body (and/or the ambient temperature inthe personal activity space, or beyond) to aid in activity recognitionand analysis. In some embodiments, infra-red radiation readings may betaken from defined objects only, within a set distance, by imaging orotherwise directional temperature-related external infrared sensor(s)107. The set distance may be variably set by the user and/or system, todefine objects relevant to their physical activity, for example, by useof lenses or other selective or focal elements for focusing infra-red orother heat-related radiation emanating from such nearby objects. Forexample, in the figure, a focal and/or depth-of-field of the lens(es)may substantially render objects for object recognition, definition andanalysis if they lie within a radius surrounding the device 101 orsensors 107 between 4 and 70 inches (for adult males), or smaller radiifor children or women, for example, but such radii may be variably setby the user and/or system, and for different activity types and/or timesof day as they occur or are recognized, on an ongoing basis. Butpreferably, the radius or other spatial and distance limit for objectrecognition, definition and tracking is sufficient to substantiallyinclude most personal activity-relevant objects for the user (thusdefining a “personal activity space”), while eliminating recognition,definition and tracking of from more distant objects, or, at least,placing them in a different category for activity-relevant analysis,such as those factors defining a more general venue relevant to theuser's activity, rather than being included as movement directly causedby the user's activity. Preferably, at least two infrared sensors 107are used, to aid in object location in three-dimensional space, butthree such sensors are preferred, to simplify 3-D object definition andlocation in space. A single sensor may also be used, however, in someembodiments.

At least one exemplary tracked, defined and analyzed moving object isdepicted in the figure: namely, a burger 109. As shown in the figure,the core temperature of burger 109 is, at the time depicted, 189 degreesFahrenheit. As such, the sensors 107 may, for example, recognized theburger 109 as an object with a temperature substantially heightened fromthe core temperature of the user, with boundaries between 5 and 10inches away from the device 101 and/or sensors 107 and, depending uponthe embodiment, may further define the size of the object and likelymatches for the object. As the user begins to consume the burger, thedevice and sensors may track the burger 109's movement as an object, asit is carried into different positions, acceleration and movementvectors (or patterns thereof) relative to the user 100, device 101 andsensors 107 (for example, arcing toward the user's mouth, above thedevice 101 and sensors 107). That sensed data may then be delivered to aCPU or other control system for storage and further analysis by thesystem. An exemplary control system is discussed in greater detailbelow, in reference to FIG. 7.

Based on a wide variety of possible object recognition, definition andtracking algorithms, each of which fall within the scope of theinvention, but do not limit it, the control system may determine that,based on the shape, size, temperature, temperature loss and loss rate,movement, other activity and other sensed and recorded factors, that theuser is likely consuming a burger, and may further determine theburger's type based on a library of profile data for each such factorrecorded. This recognition activity may be enhanced at the time, andenhanced in future object and activity tracking (by adjusting object andactivity-recognition library factors recorded for the object oractivity) by the user indicating to the system, using a separate GUI,the nature of her activity at the relevant time—which indications may becarried out simultaneously, or at a different time, and may be conducted(but need not be) on a GUI of another device (for example, on a PDA),networked to the system, with specialized software and hardware forpresenting, communicating with and controlling such a GUI.

Furthermore, the control system, with the aid of sensor data, maydetermine the change in size of the object, or transfer of part of theobject to a different, relevant location, such as the user's mouthand/or throat. The system may take such attrition in the object tocorrelate with object consumption and, based on such activity, maintaina count of likely calories, vitamins, protein and other nutritionalinformation, as consumed by the user, in aid of other data storage,analysis and software presentations on computer hardware. Some suchconsumption information may be gathered by direct sensation, forexample, by a swallowed or implanted sensor in communication with thesystem, present or scanning at least a part of the user's digestivetract, and determining the presence of food products, digestiveproducts, enzymes, bowel sounds, and other indicators of digestiveactivity. Alternatively, digestive activity itself may be inferred bysecondary, sensed data. For example, a pattern of body temperatureincrease may be correlated by the system with a conclusion that the useris or may be consuming different types and amounts of food, withdifferent caloric and other nutritional and other properties. As anotherexample, a user and or a system element, such as transceiver 101, maytake a photograph of an object to match it with a food type and assessits size, caloric value and other nutritional profile, throughphotographic object-recognition. As still another example, nearbybeacons (but outside of the user's personal activity area) may sendsignals relevant to the user's general environment and activity that maybe relevant to identifying the user's objects in her personal activityspace, as will be discussed in greater detail below. Generally, anytechnique set forth in this application may be blended, factoriallyapplied, or otherwise combined with other (extant or new) object andactivity pattern recognition techniques, to improve the accuracy of eachtechnique.

The form of sensor/transceiver device 101, although preferred, is by nomeans exhaustive of the myriad devices and device locations that may beused as discussed above. In some embodiments, a wristband, armband orother belt or sticker may be used. In others, an implanted or skinadherent version may be used, rather than a necklace form, as pictured.In some embodiments, a conventional PDA device, or other device, withall or part of a specialized sensor/monitor set or device, as discussedabove, may be used for all or some of the sensing aspects discussedabove. Some alternate forms of such a sensor/monitor set or device arediscussed in greater detail, for example, with reference to FIGS. 2 and3, below. As another possibility, but again not exhaustive, the sensorsand system aspects within device 101 may be consolidated with otheraspects, or may be separated, in a place peripheral the person. In thatinstance, distance calculations may be inferred from relative distancesfrom the user of both the user and other recognized objects, and ratherthan from sensors on a device or the device itself, exclusively. A localtag held on the person, however, such as the tags discussed in greaterdetail below, may also be used in such embodiments to aid in locatingand defining the user and his/her relevant personal activities. Itshould also be noted that the sensor types and number(s) discussed withreference to this figure are not exhaustive of the possibilities thatmay be used to carry out aspects of the present invention. For example,in some embodiments, accelerometers, GPS or other localmovement-defining systems, and tracking tags (which may be active orpassive in generating signals), as discussed below, may also be used toaid in recognition of the user's personal activities.

In addition to object, motion and activity definition and trackingaspects set forth above, the system may extrapolate a wide variety ofadditional relevant, activity and other health-related data to enrichits resources relative to a user′ account on the system. For example,sensors 107, or other sensors, in a device such as 101 may sense heatflux (influx and efflux across the surface of the user's body) todetermine or approximate the amount of heat energy currently being lostby a user, to make caloric loss inferences as well as aid in defining auser's activity level. Similarly, humidity sensors and meters forambient and user-transpiration-caused humidity, and galvanic resistancesensors, inferring sweat and other evaporative heat loss as well asradiative heat loss, may be included in device 101, to aid, among otherthings, in defining the user's exertion level and/or heat stress, aswell as caloric energy loss (and compare it to food and drink caloricconsumption information, and losses caused by exercise that isnon-redundant with that loss, to determine a complete caloric profile).With data from such sensors indicating higher-than-average calorieburning by the individual, and within a range associated by the systemwith greater exertion, such as high-cardiovascular-impact exercise, thesystem may implement an algorithm making determination that the user ispresently exercising, and may further record and analyze that conclusionfor later purposes. As another example, additional sensors on device 101may take an ambient temperature, to better estimate the user's heatdifferential (and stress) with respect to his or her environment.

Some sensor methods may be newly-blended to obtain better results. Forexample, active irradiation and reception for ranging, location,collocation and tracking of objects may also, as reflected back,indicate other conditions of the user, as with infrared irradiation andradiation, which, based on differences in intensity from reflection,reabsorption and resulting efference from the object, also may indicatetemperature(s) of the object. In addition, a new form of differentiatedradar, sonar or other reflective radiation tracking, where angularranges of efferent radiation are sent with signature coding, andreception back may aid the system in determining whether a signal hasbeen reflected multiple times or has otherwise been scattered, to morehighly resolve object, its contours in space, and object activity mapsand patterns by inferring 3-dimensional repeated reflection (and surfaceangle) information.

The device 101 may contain blood pressure monitors, ECG contacts,heart-rate monitors, a breathing-rate monitor, air quality and V02sensors on or about the user, other internal or external bodily activitymonitors (which may be with the aid of internal sensors indicating thestatus of internal bodily operations) and other health and vitalsmonitoring sensors and gears for recording, transferring and analyzingsuch information to the system.

FIG. 2 depicts an alternate form of personal activity defining, trackingand analyzing device 201, used in conjunction with a second sensor set203, which may track one another, in addition to recognizing, defining,tracking and analyzing objects, in aid of personal activity definitionand analysis by a system. As with device 101 and its sensors 107 fromFIG. 1, above, each device 201 and 203 are located on or about a user'sbody, 200. But, as should be understood with respect to FIG. 1, a widevariety of alternate locations, on or about a user's body, clothing orpersonal effects, may, alternatively, or in addition, be used. Also aswith device 101, either device 201 or 203 may include a set of infra-redand/or other sensors, capable of carrying out but restricting types ofobject recognition to a relevant radius from the sensors (notspecifically pictured). In addition, one or both devices 201 and 203 mayinclude accelerometers, GPS or other local movement-defining systems,and trackable tag(s) or transmitting, receiving or transceivingantennas, such as those pictured as antennas 205 and 207. Antennae 205and 207, among other things, may sense the relative position, distance,movement, acceleration (and patterns thereof) between one another, toassist in assessing the personal activity of the user, by deliveringsuch data to a CPU or other control system for storage and furtheranalysis by the system, including, but not limited to, personal activitydefinition and analysis. By using such multiple devices 203 and 201,with such sensor arrays, and with defined relative position, speed andacceleration data, the system may, in some embodiments, better definepersonal activity than with one device and sensor array, although thecost may also be greater.

As an example, the user in FIG. 2 is currently engaging in a sportingpersonal activity—namely, playing tennis. As such, she is holding atennis racket 209 in her right hand, which is the same hand on which shewears device 201 (preferably her dominant hand). Each device 201 and 203may then track the tennis racket 209 as an object within their focalradii (depth-of-field of their infra-red sensors' lenses) and, inconjunction with their relative physical data, better define thelocation, size, shape, movements and other characteristics of the racketfrom multiple angles. In such an embodiment, the sensors on each device201 and 205 may be made fewer on each device, and a single rather thanmultiple infrared sensors may, for instance, be used due to the multiplelocations of the two devices, 201 and 203. Lensing may also be omittedin favor of the system analyzing varying angle, orientation andpositional data from the two devices, 201 and 205, to define and analyzeobjects from simpler (e.g., range only) data. In any event, as with thesingle device discussed with reference to FIG. 1, the multiple devices201 and 205 may determine that the temperature of the racket 209 fromwhich infrared radiation is emanating is substantially below the user'score body temperature. From this, the system may infer that a movingobject within the user's personal activity space (or radii) defined bythe depth-of-field or variably set distance parameter, is shaped like aracket and an inanimate object that has not been, for example, recentlycooked for consumption, unlike the foodstuff object discussed in FIG. 1.From these data, delivered to a control sub-system of the system (suchas the control system discussed with reference to FIG. 7, below, andother pattern and object matching, the system may determine that theuser is presently engaging in the personal activity of playing tennis.Further data, for example, related to patterns of relative movementbetween the two devices 201's and 203's sensors, other sensors, and/oraccelerometers, may also be delivered to the control system and furtheraid the system in determining activity levels (e.g., intensity ofexercise) likely calories burned, cardiovascular impact, and otheranalytical outcomes. Such additional sensors may include, for example,other local tags, for example, tag 211, placed on the racket by a userof the system. Such tags, if placed, may define objects on which theyare placed and transmit data to the system (for example, via one of thedevices 201 and 203, which may include and/or be networked to a controlsystem. As with the antennas 205 and 207 of devices 201 and 203, fromsuch transmitted data from tag 211, a control system may determine therange or more complex movement data for the tagged object, as well asit's identity and orientation, to aid in activity pattern matching,definition and further analysis. In some aspects of the invention, auser may assign identities and types to a form of tag withuniquely-identifiable transmissions (in comparison to other tags) from alibrary of possible object types within the system (which may beexpanded by the user and/or system, as can a similar library of possibleactivity types and intensity levels), and the proper orientation of thetags may be correlated with the position of the object on which it isplaced, either by user-definition and/or calibration routines, or byorientation instructions from the system to the user (e.g. what locationand orientation to place the tag on the object, based on itsdefinition). For example, such tags may have unique, coded reactions toexternal radiation pings, for example, transmitted from one or both ofthe devices 201 or 203, such as resonant or partially absorbedvibrations or re-transmissions of such pings to the device(s) 201 or203, which then may recognize the tag, and associated, defined objectcurrently within the personal activity space of the user, and itsmovements, and extrapolate other analysis therefrom.

As mentioned above, to further aid the system in recognizing, defining,recording and analyzing personal activity, a user may utilize a GUI,which may be presented on one of the devices 201 and/or 203. Such a GUIis depicted as GUI 213, on device 201. GUI 213 may include displayelement(s), areas or element orders, such as 215 and 217, anduser-actuable controls, such as exemplary scroll arrows 219, and “yes”or “no” input buttons 221 and 223. Display 215 may, among other things,and as pictured, display the system's current evaluation of the presentpersonal activity of the user. In the instance of the figure, forexample, the system may have determined, through the data sourcesdiscussed above, and applying matching profile libraries, that the useris most likely currently playing tennis. The user may therefore viewthis analytical conclusion on element 215 and, if she agrees, indicateto the system that she is, in fact, undertaking the assessed activity byactuating “yes” button 221, next to it. If, however, the system'sassessment is wrong, she may so indicate by actuating the “no” button223. After that, another displayed message, such as the system's nextbest guess for activity, may be offered. The system may take such inputfrom a GUI from the user and, based on alterations to system-alterablealgorithms, define or improve its definition of the user's activity, andthe resulting influence of that activity definition on calorie burning,cardiovascular impact, and other analyses for the user's personalactivity. Display element 217 may display additional (possiblysecondary), relevant information to the user relevant to his or herpersonal activity, and such as (as pictured) the amount of time that thesystem has determined has been spent performing the currently assessedactivity type (i.e., playing tennis). In some embodiments, the user mayactuate a GUI control to set the start and end points of new activitiesand make other commands, such as selecting a displayed, actuable GUIaspect (not pictured) and the user may scroll through various displayeddata, using scroll controls 219.

The types of data input and output and user controls set forth above areexemplary only, and any form of user setting and/or control necessary orpossible by a user, as set forth in this application, may be carried outin alternate GUIs, GUI-providing or other device(s), and/or sensor(s) orset(s) thereof, which may be used alternatively, or in addition to theGUI and sensor examples discussed above. In addition, any other personalactivity- or other health-relevant data may be entered and transmittedto the system for processing, in other embodiments of the invention—notjust personal activity types and durations, as discussed specificallyabove. For example, a user and/or system may gather, identify, track,record and analyze data concerning eating behavior, sleep activity andpatterns and compliance with medical regimens, among myriad otherpossibilities.

FIG. 3 depicts a personal activity defining, tracking and analyzing basestation 301, used in conjunction with specialized sensor tags by asystem to identify, define, track and analyze personal activity, inaccordance with aspects of the present invention. The base station 301may comprise or be networked with a control system, such as theexemplary control system discussed with reference to FIG. 7, below, andfurther comprises communications capability and, preferably, wirelesscommunications and power-providing capability, such as transceiverantenna 303. Also preferably, base station 301 is placed in an areanear, but outside of the personal activity space used by a user, whoseactivity is identified, defined, tracked and analyzed by the system.Even more preferably, base station 301 is placed near enough to apersonal activity space that communications will be possible with tagsplaced on or about the personal activity space, but does not physicallyinterfere with that personal activity space, or the depth-of-field orother personal activity space or radii otherwise defined by the userand/or system.

A user 305 is pictured in a seated position, performing bicep curls on abicep curl machine 307. Within, on or about the machine 307, and alsowithin the user 305's personal activity space, are specialized tags 309and 311, each of which is unique and capable of receiving a radiatedsignal and, as a result, transmitting a somewhat weaker resonant signalwith unique identification properties indicating from which tag itoriginated. For example, the base station may send an initial signal313, for example in a pulse or burst format, at a frequency with whichtag 309 resonates and, as a result, next produces its own uniqueresulting (and uniquely resulting from the nature of the signal itreceived) signal 315. Next, tag 311 receives signal 315 and, owing toits properties, may resonate with that signal and produce its own uniqueresulting (and uniquely resulting from the nature of the signal itreceived) signal 317, which may then be received by the base station.Although directional lines are shown for each of the signals, todemonstrate where they are received, they may not be directional innature. In fact, each resulting signal from a tag loses substantialstrength in comparison to its source signal, from which it radiates, asit radiates outward and due to energy losses in the resonant process.But, in any condition of the equipment and ambient environment,including with interceding bodies between the base station and tag 311(or 309 if it, instead, is used as the final tag in the signal chain, inanother embodiment), the final resulting signal 317 is strong andcomplete enough that the base station is capable of receiving,processing identifying and analyzing it. The unique reaction to uniquesignals of each tag may be by the resonant properties of the tag (whichmay be multi-variate and react to unique frequency patterns and othercoding) may be due to the properties of a resonant material, selectiveabsorption and reflection, or from active modulation (for example, withthe aid of a local processor on board each tag).

As the user 305 performs bicep curls on machine 307, a lever 319attached to curling bar handles 321 may variably rise upward (on theuser's bicep flexion) and downward (on the user's arm extension byrelaxing his biceps). Tag 309 has been placed within, on or about lever319 and, as a result, will rise upward and downward along with themovements of lever 319. Tag 311, by contrast, is placed within, on orabout a fixed part of machine 307 relative to the floor 300 and majorityof machine 307 and user 305, and, therefore, tag 309 will move relativeto tag 311 as the user 305 performs the bicep curl exercise. Becauseeach of tags 309 and 311 receives a signal (313 and 315, respectively)that has experienced power attrition over the course of its travel, andbecause the power attrition of signal 315 as it reaches tag 311 willvary based on the variable distance between tags 309 and 311, thestrength of the resonation or other harmonic or other resulting uniquesignal 317 will itself vary based on the position of lever 319. Inaddition, the change in signal strength will directly andproportionately relate to the change in distance between the stationaryand moving tag pair, making movement tracking easier to accomplish, withless variables, than with ordinary object position tracking. In someembodiments, the nature of the final, efferent signal from a tag to thebase station may vary in a character other than strength, however, inreaction to receiving different strength signals, to accomplish the samemovement tracking objective. From this, over time, the base station 301may analyze the variation in signal strength (or other,distance-variable properties, in other embodiments) of signal 317 toinfer when exercise is occurring on the machine. Likewise, a PDA orother system element 323 on or about the user (e.g., a wrist-mounteddevice, as pictured) may also receive signal 317 with an antenna 325,since it need not be directional, and perform the same hardware andsoftware steps to determine that the exercise is taking place, thenumber of repetitions of the exercise, and the amount of time spentperforming the exercise, or may directly communicate with the basestation to receive that information and/or identify the user performingthe exercise, for example, by assessing that the machine's tags 309 and311 are on or about the user 305's personal activity space. Likewise,the base station may ping the user's device 323, to locate it, orco-locate it with the machine in the same way as with the lever 319, andestablish his identity as the user of the machine. Other tags definingother machine movements may further aid the system in assessing personalactivity information. For example, additional unique signal-generatingtags (not pictured) may be placed on weight plates, to identify theamount of weight used, based on their movement and/or location relativeto fixed tag 311, in accomplishing the exercise repetitions. In anenvironment with several tagged machines, such as a gym using thesystem, the base station may emit different resonant frequencies towhich each initial tag, such as tag 309, responds, and leading to uniqueresonant frequencies to which each second resonating tag, such as 311,responds. Alternatively, the system may differentiate between resonatingfrequencies that are too weak to correspond with resonation causedbetween co-located tags on one machine, and disregard them as indicatorsof personal activity. For example, if the same initial signal 313reaches an initial receiving tag 327 on a treadmill 329, and which thensends a fourth resulting resonant signal 331, the system and/or theuser's device 323, may disregard that signal as too distant in origin tocorrespond with that user's location. However, such signals emanatingfrom neighboring personal activity spaces of others may still be used,for example, to aid in defining the user's environment and, secondarily,his activities.

FIG. 4 is an exemplary process flow diagram of exemplary steps 400 thatmay be taken by a system, such as (but not limited to) a hardware andsoftware control system of the nature discussed, for example, withreference to FIG. 7, implementing aspects of the present invention, andwhich may be a part of a larger personal activity monitoring andanalysis system.

Beginning in step 401, the control system first determines whetherActivity-defining or—condition signals have been received by the controlsystem. Such signals may come in a multitude of forms, as discussedfurther below, and elsewhere in this application, and may assist thecontrol system in determining a type, amount, nature, direction,frequency, duration, and intensity of personal activity(ies) that are,have or may occur with respect to a user whose personal activity isbeing tracked by the system. If no such new signals are currently beingreceived, however, the control system may proceed to step 403, in whichit may cause transceiver(s) to detect radiation (of any type) to testthe local environment (specifically, the user's variably definablepersonal activity space), for example, with radar, sonar, or infraredobject recognition, definition, tracking imaging, analysis and/orranging, as discussed elsewhere in this application. Following this, thesystem may next determine whether there is a definable object, apartfrom the user's body (as well as, in some embodiments, extensions of theuser's body, such as arms and legs, the activities of which may also betracked) by assessing a significant difference in temperature betweensuch object(s) and the user's core body temperature, in step 405. If nosuch object is found, or tracked as moving, in the instance ofembodiments tracking the user's body movement, the system returns to thestarting position. If, however, the system does so define an object, itmay next attempt to match it—for example, by shape, temperature, size,motion and/or other physical characteristics—with profiles of suchcharacteristics for objects and object types from a library accessibleand so comparable by the system, in step 407. If such an object match,or type of object match is made by the system (for example, within aconfidence interval which may be variably set by the user) in step 409,the system may proceed, in step 411, to record the match and/or apply itas a setting or condition influencing further activity and/or activitypattern recognition. For example, to extend the example provided in FIG.2, if the system identifies an object in a user's hand as a tennisracket for a given duration, the system may store that fact for lateruse, and create and apply an influential factor in its current patternrecognition analysis based on that match. For that duration of time, forexample, swinging movements of the user's arm that might otherwise havebeen interpreted as other movements are more likely to be identified astennis playing activity, due to that new factor taken from objectrecognition in the user's personal activity space. Similarly, if anobject in the user's hand is identified as a burger, as in FIG. 1, thatfact may be converted into a factor making eating activity more likely,and more likely to be recognized by a user's hand and head activity thanotherwise might be the case (rather than, for example, the user's handmovement towards her face being interpreted as more likely an activityof blowing her nose, absent the object recognition of the burger). Inany event, the control system next proceeds, in step 413, to attempt toperform personal activity pattern matching, from any movement perceivedin the user's personal, again, with a library accessible to the controlsystem—this time, a library of movements, accelerations, postures andother indicators of personal activity status. This activity patternmatching may be aided by sensors or other activity-monitoring datasources providing data to the system, such as accelerometers and/or GPSsub-systems, and by recognized object movement of objects thatthemselves have not been defined by the system (for example, if no matchis achieved in step 409, also leading to step 413). Next, if an activitypattern match is achieved by the system in step 415 (for example, again,within a variably set confidence interval for matching), the systemagain may store data relating to that match and/or use that match as afactor influencing its further personal activity monitoring activitiesand analysis, in step 417. But even if no such activity pattern match isnot achieved, the system may nonetheless store and analyze the unmatcheddata, for example, to determine likely calories burned, cardiovascularintensity and impact, and other outcomes of personal activity, based ondefault or general functions applied by the system, in step 419.

Next, the system may proceed, in step 421, to determine whether a userhas input further, relevant information—for example, utilizing a GUI ofa type such as that discussed with reference to FIG. 2, above. If so,the system may both store and apply such data, as indicated withreference to that figure, in step 423.

If, returning to step 401, the system instead determines thatactivity-defining or—condition signals (designed and programmed forassisting the system in that regard) have been received by the controlsystem, the system may proceed, in step 425, to determine the nature ofthe signal—such as its radiative type, frequency and any encoding—todetermine which type of signal(s) for assisting the system it is. First,the system may determine whether the signal(s) is a Personal ActivitySpace (“PAS”) signal—meaning that it is of a type used by the system toindicate activities within a user's personal activity space—in step 427.For example, the types of resonant signal examples emanating from tag(s)provided in reference to FIG. 3, above, are PAS signals, because theyoriginate from and directly indicate activity within the user's personalactivity space. Next, if such a PAS signal is detected, the system mayproceed, in step 429, to determine whether that PAS signal is of asufficient strength to originate within the user's personal activityspace. If not, the system disregards and may discards data regarding thesignal, as emanating from another person's personal activity space, instep 431. However, in some aspects of the invention, and embodiments, aPAS signal originating from beyond the user's personal activity spacemay nonetheless be used by the system as an environmental conditionindicator, which may influence the system's algorithms and personalactivity matching and analysis, as other such factors so influence thesystem, as discussed above. If the PAS signal is of sufficient strengththat the system determines it to directly indicate the user's personalactivities, however, in step 429, the system proceeds, in step 433, tostore and apply data corresponding with that signal in its personalactivity analysis, and other actions based on that analysis, asdiscussed further herein. The system may then proceed to steps 421 etseq., as discussed above, and, then, to the starting position. If, atstep 427, the system determines that the signal received is not a PASsignal, it may next determine, in step 435, whether the signal is of asufficient strength to originate in, about or near the user's localenvironment, such that it may be relevant in defining the user'spotential personal activities. The sufficient strength and distance oforigin to render that determination may, as all factors discussed inthis application, be variably set by the user and/or system. If it is ofsuch sufficient strength, the system may store and apply data relatingto that determination as a factor influencing its determination,definition, recording, matching and analysis of further personalactivities. For example, if a local signal (for example, from atransmitter of a shopping mall) is sufficiently strong and local toindicate that the user is present in the shopping environment, a bag,hand-swinging of the bag, and article movement will more likely beinterpreted by the system as of a shopping personal activity nature,rather than, for example, croquet, even if, otherwise, the arm movementmight slightly more greatly match a hand movement profile stored in thelibrary as relating to croquet, than one relating to shopping.

FIG. 5 is another exemplary process flow diagram of exemplary steps 500that may be taken by a system, such as (but not limited to) a hardwareand software control system of the nature discussed with reference toFIG. 7, implementing aspects of the present invention. The exemplarysteps may be undertaken by such a control system to govern aspects of alarger personal activity and health data tracking system, comprising thecontrol system. In particular, with respect to the steps set forth withrespect to this figure, the system may implement goal achievement orunderachievement rewards and penalties, and administer legally-bindingagreements regarding the same between tracked and other incentivizing,insuring users. The series of steps 500 undertaken as set forth in thisfigure may be undertaken periodically, for example, according to anagreed schedule, or may be undertaken on an ongoing, real-time basis,based on when new, relevant data is received by the system, orsubstantial amounts or other trigger amounts and/or types of such data,are taken in.

Beginning with step 501, the control system first assesses whether acurrent archive data storage device, preferably in the immediate andongoing control of the control system (such as memory device 703 or 705,discussed in reference to FIG. 7, below) has been updated to contain thelatest substantial or other significant amount or type of data relevantto a user's personal activities, from the remainder of the trackingsystem—for example, from storage on a PDA's local drive. If so, thecontrol system may return to the starting position. If not, however, thecontrol system proceeds, in step 503, to import, or copy and import,those data for local storage more immediately and controllablyaccessible and modifiable by the control system (“Syncing” the data),and for further processing and analysis. In step 505, the systemassesses whether the user has expressly agreed to the terms of use ofthe control system sub-services implementing incentives, as set forth insubsequent steps of the figure. If not, the control system proceeds tothe first step of FIG. 6, below. If so, however, the control systemproceeds to step 507, in which it may determine whether the datarepresents personal activity that constitutes improvement(s) towardsgoal(s). Such goal(s) may be variably set by the system and/or a user,according to input by at least one user and/or the system, or byagreement between users (such as a tracked user and control systemadministrative user, with the authority to set and deliver incentives).If the data does not reflect an improvement towards a goal, the controlsystem proceeds to step 509, in which it determines if the data reflectsa set-back, or worsened state of personal activity in comparison to suchgoal(s). If so, the control system may proceed to step 511, in which itwarns the user with a message (for example, delivered on the user's PDAbased on network communications) warning the user of potential healthand other costs of their personal activity status, in moving away fromthe user's set goals. Depending on the embodiment of the invention, ifsuch warnings occur more than a preset number of times or recur for morethan a permitted length of time, the system may proceed to adjust theuser's insurance premiums upward, or take other negative incentivemeasures (e.g., increasing the costs of a gym membership, in step 513.Following such actions, the control system may undertake variousaccounting and other administrative steps recording and effectingrelevant control system changes in light of the changed incentives, suchas, but not limited to, alerting the user of the changes, or ahealthcare provider of the user, or other peers that the user has agreedto alert, or increasing counseling or specialized healthcare visits inlight of the failure to reach the goal(s), and the goal(s) may beredefined by user(s) and/or the system in light of the occurrence of thesteps that have occurred. Following those actions, the control systemmay return to the starting point.

If, however, the system determines, back at step 507, that the Synceddata represents personal activity that is progress towards, or thatmeets or exceeds, goal(s), the control system may proceed to step 517,in which it immediately reports that progress and/or other success tothe user (for example, via network communication represented on theuser's (whose personal activity is being tracked) PDA. Next, the controlsystem may determine whether the user's personal activity met his or herpersonal activity goal(s), in step 519. If not, the system may proceedto steps 513 and 515, and carry out actions as discussed above withreference to those steps. If the user has at least met his or herpersonal activity goal(s), the control system may then proceed to step521, in which it further determines whether the user's personal activityhas exceeded his or her personal activity goals. If not, the controlsystem again continues to steps 513 and 515 and carries out actions asdiscussed above with reference to those steps, but, in this instance,reflecting that the user has met his or her goal. Such actions mayinclude delivering a promised positive reward (given as an incentive),such as lowering a user's premium cost for insurance, and alerts andnotifications related to the same. If the user has, in fact,substantially exceeded his or her personal activity goal(s), the systemmay proceed, in step 523, in which it may deliver a specialincentivizing reward, in which the amount by which the goal has beenexceeded is partially awarded back to the user, for example, as a futuregoal adjustment. Such a technique for “Partial Give-Back” rewards isdiscussed in greater detail, below.

Among other incentivizing rewards and penalties contractually agreed toby a user, the system may set and issue penalties and rewards based oncompliance with or exceeding a personal activity goal set by the system,which may be a goal set with the agreement, including, but not limitedto the express written legally binding agreement. In some aspects, areward for compliance and/or a penalty for non-compliance, per event orupon a count of a series of such goals, may include reduced or increasedcosts of fitness-related expenses or insurance coverage premiums. Inother aspects, such rewards and penalties may be on a sliding scale,based on the degree of exceeding or underachieving relative to suchgoals, and future overachievement may remove the affect of previousunderachievement, and vice versa. In a preferred embodiment,overachievement may create a reward of lower goal levels for futurecompliance, which may be only partial in comparison to the level ofoverachievement. For example, if a user has agreed to a system assessedgoal of consuming 1800 calories per day, the system may reward a userwho is assessed to have consumed 1600 calories only, in a given day, byrewarding that user with a partial give-back of 100 of the 200 caloriesoverachieved, for a total caloric limit of 1900 calories for thefollowing day. Such rewards may be phased out over time, to preventlicensing outright binge eating, for example. The term for suchincentivizing rewards is a “Partial Give-Back” reward. Conversely, apartial-take-back penalty, in which a user's failure to meet a goal ispartly reflected in future goal(s) may not preferred (to prevent apreferred incentive to cheat) and, instead, a complete assignment of theunderachieved amount, or an even greater amount, is assigned to futuregoals. Generally, the system may implement a system of floating goalsand rewards, to best achieve the user's longer-term objectives. Forexample, if a user's objective relates to increasing their muscle mass,while decreasing body fat, daily, weekly or other goals for foodconsumption and physical activity may vary based on the user'sbio-rhythms, such as recent sleep quality, starvation-mode assessment(whereby the user's body begins to burn muscle, rather than fat, due tocaloric consumption falling too low at a given point in the day), amongany other possibility. The effect on consumption of different types ofactivities, and net calorie gains resulting, can be monitored by thesystem, and change the recommendations of the system. For example, theimportance of at least some low-intensity exercise may be surprisinglyemphasized in an algorithm applied by the associated control system, tooffset the calorie-intake/hunger boosts of higher intensity exerciseonly. Moore M S, Short-Term Appetite and Energy Intake Following ImposedExercise in 9-10 year-old-girls, Appetite 43(2):127-34 (October 2004).

In further aspects of the invention, the incentives may require no legalauthority and meted out consequence to administer, but, rather, thesystem may simply offer observations that may incentivize the user as anatural consequence. For example, when the system warns a user of healthconsequences for deterioration in personal activity levels, or suchlevels that fall below advised levels for a user's age and otherdemographics, or personal situation, or when the user's other personalhealth-relevant data does not meet safe or desired levels, there may bea natural incentivizing effect. By communicating and illustrating likelyoutcomes and events (including, but not limited to, long-term outcomes)for personal activity and other health status data, the system mayunderscore such natural incentives.

FIG. 6 is another exemplary process flow diagram of exemplary steps 600that may be taken by a system, such as (but not limited to) a hardwareand software control system of the nature discussed with reference toFIG. 7, implementing additional aspects of the present invention. Morespecifically, in the event that a user of the system whose personalactivity is being tracked has not yet set goals for personal activity,or legally agreed to participation in a contract or programincentivizing rewards and penalties (“Incentive Program”), as determinedin step 505, above, the terms of which may be carried out as shown inthe remainder of FIG. 5, above, the system may proceed to the steps setforth in this figure.

Beginning at step 601, the system proceeds to present the user with anoverview of program aspects, for example, in the form of statementsdisplayed on the user's PDA concerning the Incentive Program's goals,conditions and rewards and penalties, as well as other major terms andconditions to participation in the Incentive Program. If, afterreviewing that overview, the user elects to proceed in step 603, thesystem may proceed to produce a questionnaire, in step 605, forgathering basic information necessary for the further administration ofthe Incentive Program (for example, user identity, age, occupation,proof thereof, credit card information for charging penalties, currentpersonal activity and other health-related information, etc.). If theuser has successfully completed the information requested in the intakequestionnaire in step 607, the system may proceed, in step 609, topreview for the user a series of Incentive Program options, such asvarying levels and types of goals for improving personal activity andactivity levels, such as, but not limited to, exercise activities,medicine compliance and dietary intake—along with the potential rewardsand penalties for meeting or failing to meet those goals. If the systemdetermines that the user has accepted or selected certain of thoseoptions as goals, in step 611, the system may proceed to present thoseoptions as accepted options (provisionally) and further present the userwith a full copy of an Incentive Program contract, dictating the entireunderstanding of the participating user and any person, business entityor other individual or organization responsible for and/or running theIncentive Program with the aid of the system (an “administrator”) instep 613. The user to be subject to personal activity analysis then mayformally accept that agreement, in step 615, or, if no longer interested(or at any other point) may exit in step 621, to use the system withoutthe influence of the Incentive Program. If the user has accepted theagreement, but his or her failure to scroll through it, or specificallyindicate that he or she has read the agreement (for example, in a checkbox) indicates that he or she may not have read through the entireagreement, the system may request that the user so read through everypart of the agreement, and so indicate, in step 617. At that point, theuser may be an active participant in the Incentive Program, and mayreturn to step 501, to continue use of the system in that capacity.

If, however, the user has exited at step 621, at any point, the systemmay instead enter an operational mode for users who are notparticipating in the Incentive Program, at steps 623 et seq. Steps 623et seq. are similar to steps described in reference to FIG. 5, butwithout provisions requiring legal participation in the IncentiveProgram. At step 623, as with step 501, the system assesses whether acurrent archive data storage device, preferably in the immediate andongoing control of the control system (such as memory device 703 or 705,discussed in reference to FIG. 7, below) has been updated to contain thelatest substantial or other significant amount or type of data relevantto a user's personal activities, from the remainder of the trackingsystem—for example, from storage on a PDA's local drive. If so, thecontrol system may return to the starting position of FIG. 5. If not,however, the control system proceeds, in step 625, to import, or copyand import, those data for local storage more immediately andcontrollably accessible and modifiable by the control system (“Syncing”the data), and for further processing and analysis. The control systemnext proceeds to step 627, in which it may determine whether the datarepresents personal activity that constitutes improvement(s) (which mayinclude improvement(s) towards goal(s) non-legally bindingly set by theuser and/or system). Such goal(s) may be variably set by the systemand/or a user, according to input by at least one user and/or thesystem, or by agreement between users (such as a tracked user andcontrol system administrative user, with the authority to set anddeliver incentives). If the data does not reflect an improvement towardsa goal, the control system proceeds to step 629, in which it determinesif the data reflects a set-back, or worsened state of personal activityin comparison to such goal(s). If so, the control system may proceed tostep 631, in which it warns the user with a message (for example,delivered on the user's PDA based on network communications) warning theuser of potential health and other costs of their personal activitystatus, in moving away from the user's set goals. Following such action,the control system may undertake various accounting and otheradministrative steps recording and effecting relevant control systemchanges in light of the changed incentives, such as, but not limited to,alerting the user of the changes, or a healthcare provider of the user,or other peers that the user has agreed to alert, or increasingcounseling or specialized healthcare visits in light of the failure toreach the goal(s), and the goal(s) may be redefined by user(s) and/orthe system in light of the occurrence of the steps that have occurred,in step 633. Following those actions, the control system may return tothe starting point of FIG. 5.

If, however, the system determines, back at step 627, that the Synceddata represents personal activity that is progress towards, or thatmeets or exceeds, goal(s), the control system may proceed to step 635,in which it immediately reports that progress and/or other success tothe user (for example, via network communication represented on theuser's (whose personal activity is being tracked) PDA. Next, the controlsystem may determine whether the user's personal activity met his or herpersonal activity goal(s), in step 637. If not, the system may proceedto step 633, and carry out actions as discussed above with reference tothat step. If the user has at least met his or her personal activitygoal(s), the control system may then proceed to step 639, in which itfurther determines whether the user's personal activity has exceeded hisor her personal activity goals. Regardless of whether or not the userexceeded his or her goals, the control system again continues to step633 and carries out actions as discussed above with reference to thatstep, but, in this instance, reflecting that the user has met his or hergoal or exceeded it. Such actions may include alerts and notificationsrelated to the same.

The sequence and pathways, and exemplary steps themselves, as set forthin reference to FIGS. 4-6 are illustrative, and not exhaustive, of themany possibilities that fall within the scope of the invention.

FIG. 7 is a schematic block diagram of some elements of an exemplarycontrol system 700 that may be used in accordance with aspects of thepresent invention, such as, but not limited to gathering data fromsensor(s), sending alerts and other communications, sensing user orperson's personal activity within personal activity space(s),provisioning user settings and permissions, presenting and recordinglegally binding agreements, and receiving control commands and managinginput interfaces, such as, but not limited to a GUI, as defined anddiscussed elsewhere in this application. The generic and othercomponents and aspects described herein are not exhaustive of the manydifferent systems and variations, including a number of possiblehardware aspects and machine-readable media that might be used, inaccordance with the present invention. Rather, the system 700 isdescribed to make clear how aspects may be implemented. Among othercomponents, the system 700 includes an input/output device 701, a memorydevice 703, storage media and/or hard disk recorder and/or cloud storageport or connection device 705, and a processor or processors 707. Theprocessor(s) 707 is (are) capable of receiving, interpreting, processingand manipulating signals and executing instructions for furtherprocessing and for output, pre-output or storage in and outside of thesystem. The processor(s) 707 may be general or multipurpose, single- ormulti-threaded, and may have a single core or several processor cores,including, but not limited to, microprocessors. Among other things, theprocessor(s) 707 is/are capable of processing signals and instructionsfor the input/output device 701, to cause a display, light-affectingapparatus and/or other user interface with active physical controls (anyof which may be comprised in a GUI) to be provided for use by a user onhardware, such as a personal computer monitor or PDA screen (including,but not limited to, monitors or touch- and gesture-actuable displays) orterminal monitor with a mouse and keyboard or other input hardware andpresentation and input software (as in a software application GUI),and/or other physical controls.

For example, and with particular emphasis on the further aspects of theinvention discussed in this application, in connection with FIGS. 1-6,the system may carry out any aspects of the present invention asnecessary with associated hardware and using specialized software,including, but not limited to, application window presentation userinterface aspects that may present a user with a software GUI forselecting properties, changing permissions for user and other person'sentry, creating and changing settings for tracking, defining,identifying, analyzing and recording objects and personal activity,generating alerts and other communications, syncing data from localsources to more local and immediately controllable storage locations forthe control system (such as memory 703 and storage media 705), datacompiling and analysis, implementing incentive rewards and penalties andgenerally carrying out any control system steps set forth with referenceto the remainder of the figures in this application. As another example,with reference to FIG. 2, such hardware and software may, with orwithout the presentation of options to a user for selection on aconventional display, carry out any control aspect of the invention asnecessary and proper, such as, but not limited to interpreting,implementing and responding to user input for identifying activitytypes, and the timing of such activity, among other GUI entries, sendingalerts, and other user interface and processing aspects that may be usedin the art, such as physics engines, physical modeling, detection,internet or other network protocols and encryption, image-creation,recording and remote or local (such as wired or physical interface)control (and related software).

The processor 707 is capable of processing instructions stored in memorydevices 703 and/or 705 (and/or read-only memory (“ROM”) or random-accessmemory (“RAM”)), and may communicate with any of these, and/or any otherconnected component, via system buses 775. Input/output device 701 iscapable of input/output operations for the system, and mayinclude/communicate with any number of input and/or output hardware,such as a computer mouse, keyboard, entry pad, actuable display,networked or connected second computer, other GUI aspects, camera(s) orscanner(s), sensor(s), sensor/motor(s), range-finders, GPS systems,receivers(s), transmitter(s), transceiver(s), transceiving tag(s) (bothactive and passive, resonant or otherwise-uniquely-responding to aninput signal with a uniquely-identifiable product signal), antennas,electromagnetic actuator(s), mixing board, reel-to-reel tape recorder,external hard disk recorder (solid state or rotary), additional hardwarecontrols and actuators, light sources, speakers, additional video and/orsound editing system or gear, filters, computer display screen or touchscreen. It is to be understood that the input and output of the system,and the tag(s), may be in any useable form, including, but not limitedto, signals, data, commands/instructions and output for presentation andmanipulation by a user in a GUI. Such a GUI hardware unit and otherinput/output devices could implement a user interface created bymachine-readable means, such as software, permitting the user to carryout any of the user settings, commands and input/output discussed above,and elsewhere in this application.

701, 703, 705, and 707 are connected and able to communicatecommunications, transmissions and instructions via system busses 775.Storage media and/or hard disk recorder and/or cloud storage port orconnection device 705 is capable of providing mass storage for thesystem, and may be a computer-readable medium, may be a connected massstorage device (e.g., flash drive or other drive connected to a U.S.B.port or Wi-Fi) may use back-end (with or without middle-ware) or cloudstorage over a network (e.g., the internet) as either a memory backupfor an internal mass storage device or as a primary memory storagemeans, or may simply be an internal mass storage device, such as acomputer hard drive or optical drive.

Generally speaking, the system may be implemented as a client/serverarrangement, where features of the invention are performed on a remoteserver, networked to the client and made a client and server by softwareon both the client computer and server computer. Input and outputdevices may deliver their input and receive output by any known means ofcommunicating and/or transmitting communications, signals, commandsand/or data input/output, including, but not limited to, input throughthe devices illustrated in examples shown as 717, such as 709, 711, 713,715 and 777 and any other devices, hardware or other input/outputgenerating and receiving aspects. Any phenomenon that may be sensed maybe managed, manipulated and distributed and may be taken or converted asinput or output through any sensor or carrier known in the art, or thatmay become so known. It is understood that any form of electromagnetism,compression wave or other sensory phenomenon may include such sensorydirectional and 3D locational information, which may also be madepossible by multiple locations of sensing, preferably, in a similar, ifnot identical, time frame. The system may condition, select all or partof, alter and/or generate composites from all or part of such direct oranalog image or other sensory transmissions, including physical samples(such as DNA, fingerprints, iris, and other biometric samples or scans)and may combine them with other forms of data, such as image files,dossiers or metadata, if such direct or data encoded sources are used.

While the illustrated system example 700 may be helpful to understandthe implementation of aspects of the invention, it is understood thatany form of computer system may be used to implement many control systemand other aspects of the invention—for example, a simpler computersystem containing just a processor (datapath and control) for executinginstructions from a memory or transmission source. The aspects orfeatures set forth may be implemented with, and in any combination of,digital electronic circuitry, hardware, software, firmware, or in analogor direct (such as electromagnetic wave-based, physical wave-based oranalog electronic, magnetic or direct transmission, without translationand the attendant degradation, of the medium) systems or circuitry orassociational storage and transmission, any of which may be aided withenhancing media from external hardware and software, optionally, bywired or wireless networked connection, such as by local area network(“LAN”), wide area network (“WAN”) or the many connections forming theinternet or local networks. The system can be embodied in atangibly-stored computer program, as by a machine-readable medium andpropagated signal, for execution by a programmable processor. The methodsteps of the embodiments of the present invention also may be performedby such a programmable processor, executing a program of instructions,operating on input and output, and generating output. A computer programincludes instructions for a computer to carry out a particular activityto bring about a particular result, and may be written in anyprogramming language, including compiled and uncompiled, interpretedlanguages, assembly languages and machine language, and can be deployedin any form, including a complete program, module, component,subroutine, or other suitable routine for a computer program.

FIG. 8 is a perspective drawing of a partially-opened food packagingcontainer 801, containing several food bars, such as the examples shownas 803. Together, and with further aspects described below, food bars803 and their packaging 801 may implement a nutritional inventory andtracking system according to aspects of the present invention. Thatsystem may also comprise a computer hardware and software controlsystem, examples of which are discussed in greater detail above, and,specifically, with reference to FIG. 7.

Container 801 may include, contain or comprise at least one master tag805, which, as with other tags discussed above, may be locally poweredor powered by an external aspect, such as the control system, and may beuniquely identifiable (containing, for example, UPC information, orother encoding readable by the system to determine product informationto be tracked by the system). As with other tag aspects discussed above,to be readable and trackable by the control system, the master tag 805may reflect, partially reflect, resonate, partially absorb or otherwiseprocess and return a radiation or other signal sent from an aspectexternal to the master tag 805, such as an aspect of the control system,or inventory tags (which will be discussed below) and such efferentsignals may be unique and uniquely originate from each tag in responseto particular signals received. Alternatively, or in addition, themaster tag itself may broadcast unique radiation and other signals,readable by the control system (for example, via an antenna aspect ofthe control system) and containing the same information as a signalprocessed and returned by the master tag 805.

Each food bar item 803 may be individually packaged, with packaging thatcontains additional, uniquely identifiable inventory tags 807.Alternatively, and as will discussed in greater detail below, bar items803 may themselves contain consumable or removable inventory tags 807.As with other secondary tags, set forth above, inventory tags 807 mayuniquely respond with an uniquely identifying signal (for example, byharmonic resonation, partial absorption, partial reflection, or acombination of any of these) to unique signals received by them from anexternal source, such as an aspect of the control system, master tag805, or another external source, by emitting their ownuniquely-identifiable signals. Also as with other tags set forth in thisapplication, tags 807 may, alternatively, or in addition, themselvesbroadcast unique radiation and/or other signals, readable by the controlsystem (for example, via an antenna aspect of the control system). Inany event, in a preferred embodiment, a unique signal so emitted byinventory tags 807 may then interact with master tag 805, causing it touniquely respond by emitting its own unique signal, which is unique tothe both the source(s) signal and the master tag, and uniquelyidentifiable by the control system, for example, to determine the numberof tags, and other meta data. Master tag 805 may be uniquely situated,bridging both sides (inside and outside) of the outer wall 809 of a foodcontainer, such that signals from the master tag are easier for anexternal control system to read. In addition, where a master tagsimultaneously receives and responds to multiple uniquely identifiablesymbols from differing numbers and identities of food items 803 withinthe container 801, it may produce a unique summation signal(s), which isreadable by the system to determine a count and identity of all fooditems within the container, as well as the unique information discussedabove concerning the container itself. In this way, the control systemcan rapidly determine the identity and amounts of available or consumedfood items 803, within each unique container 801 that may, for example,be within a larger inventory managed and tracked by the control system.Master tag 805 also may be uniquely capable in other respects, forexample, in receiving power from a control system and creating anefferent signal. Master tag 805 may also have the ability to perceptiblyalter its signal that it returns to the base station in reaction tosignals, which may be with the aid of such external power, based on farweaker received signals from other tags. The same capabilitydifferentials may exist for other tag sets (for example, for trackingpersonal activity) a main signal element, and other signal elements,within the context of a consumable tag, as discussed below.

FIG. 9 is a perspective drawing of a partially-consumed individual foodbar item 901, such as the food bars 803 discussed above, with referenceto FIG. 8, and comprising multiple inventory tags 907 and inventory tagtypes at spatial intervals throughout the item, in accordance withaspects of the present invention. Food bar 901 comprises entirelyrelatively safely consumable material, including tags 907, and furthercomprises an edible outer layer or surface 903. Food bar 901 has,however, been bitten into by a consuming user, removing part of the bar901, and, as a result, a left-hand side 905 of the bar is shown that isnot covered by outer layer or surface 903. As a result, from side 905,one may see internal food stuff 909 of two varieties: an upper nougat911 and a main vitamin and protein blend 913, in separate sections ofthe bar 901. Embedded in each food stuff 909 are individually uniquelyidentifiable consumable tags 907, and, in some embodiments, those tagsmay be uniquely identifiable based on which food stuff they are embeddedin. In other words, tags 907 may be of two types, each with an at leastpartial encoding in signals transmitted from them reflecting the type offood stuff they are embedded in: nougat tags, such as those examplesshown as 915, and blend tags, such as those examples shown as 917. Inaddition, in some embodiments, tags 907 may be differentiated in theirefferent signal encoding based on their location within bar 901. Thetags 907 are preferably placed at uniform distances from one anotherthroughout the bar and each food stuff, or randomly so distributed, suchthat a count of such tags may correspond with a proportion of foodremaining, in which they are deposited. In this way, a control systempinging or otherwise sending signals to the tags (which may be through amaster tag(s), as discussed above), or simply receiving their efferentsignals, can infer how much of the bar 901 as a whole, and how much ofeach food stuff has been consumed. As will be explained further, below,the identity of consumer users ingesting the food stuffs, and morecomplex data, such as food absorption and caloric uptake, can also bedetermined by more complex types of consumable tags. But, in someembodiments, each tag 907 may not be uniquely identifiable in comparisonto all other tags 907, but, instead, they are identifiable as tags of acommon type, and a control system may infer some (albeit less)consumption information from counts of instances of signals receivedwhen scanning a food unit, such as food bar 901.

FIG. 10 depicts an exemplary consumable tag 1001, such as the consumabletags discussed above, but also containing a sensor array 1003 andsensor-exposing pump/conduit 1005, which may comprise an ionpump/conduit. Consumable tag 1001 is preferably streamlined for passagethrough a consumer/user's digestive tract, and, as mentioned above,composed of materials safe for human or other animal consumption. Tags1001 comprise an antenna or other radiative signal/response element1007, which, as discussed in detail above, may emit auniquely-identifying signal, from its own power source and/or anexternal power source, and may so emit unique signals in response toreceiving pinging or other signals unique to a source (such as a controlsystem). As discussed above, such unique signals may be unit (tag)specific in their identification properties, and may include usefulinformation concerning the tag and/or associated items (such as foodstuffs consumed with the tag), and/or may uniquely identify types ofitems associated with the type of tag. In addition, tag 1001 maycomprise multiple functional sections such as: (1) asensory/communications section 1011 and (2) a deployment/hatch section1013, which preferably partially overlap to maintain an airtight sealprior to deployment (in consumption by ingestion). Those multiplesections may disengage upon some stimulus related to a point indigestion, or selectively disengage upon signaled instruction from acontrol system, but preferably disengage upon ingestion by entericdissolution of one of the section's outer linings. Upon so disengaging,deployment/hatch section 1013 may, optionally, deploy a payload forconsumption, such as a medicine or vitamin payload, 1015. In such event,the sensor array 1003 may test for medicinal, vitamin or other payloadconcentration and/or reaction products, but, if embedded and associatedwith food, sensor array 1003 may test for the concentration and/orreaction products of the associated food, or components thereof, toinfer absorption and digestion information, as well as othergastrointestinal conditions and activities. When sensor 1001 isdeployed, and sections 1011 and 1015 are separated, sensor array 1003 ispreferably then at least partially exposed within the pathway of thedigestive fluid surrounding it after ingestion, which may be pumpedacross it with the aid of pump/conduit 1005. Pump/conduit 1005 may useion-driving variable charge components, such as those shown as 1021, topolarize and drive, or simply drive ions in the surrounding fluidthrough a channel 1023 containing at least part of the sensor array 1003with rhythmic, ion-moving charge oscillation patterns. For example, thelower component 1021 may take a positive charge in one instant, pullingopposingly charged ions toward it after the upper component 1021 hastaken on the same charge, locking such ions from passing from above and,as a result, create an inward-rushing current from the lower section ofchannel 1023. The upper component 1021 may then release its positivecharge and permit the flow to continue upward, while the lower component1021 begins reversing its charge, as the ions pass beyond it, upward.But other, for example, electromechanical, pump methods may also, oralternatively, be used. A local processor, such as a CPU, 1017, maycommunicate with, run and manage sensor array 1003 and such a pump, withthe aid of a power source 1019, but an at least partially external powersource and/or processor may also, or alternatively, aid in running,managing and powering the sensor array 1003, for example, by emittingradiative power and signals, both powering and managing the array.

FIG. 11 depicts an exemplary consumable tag 1101 comprising multiplesignal/response elements 1107, which may interact with one another aswell as a control system, in accordance with aspects of the presentinvention. Each signal element 1107 is held within a separate section oftag 1101, such that, as each chamber may variably and separately open tothe outer environment (i.e., a consumer user's digestive tract) atselectably different times and empty and deliver a payload (for example,of medicine, vitamins, markers and/or other agents) the signal element1107 held in that section is removed from the tag 1101. By being removedfrom the tag 1101, any signal element may then no longer communicatewith a main signal element 1108, which (owing to its positioning, sizeand/or different shielding from the exterior components of tag 1101 andsignal communications properties) is more capable of communicating witha control system (e.g., sending and/or receiving signals from thecontrol system's antenna) than the remainder of signal elements 1107.However, owing to their proximity and other properties relative to mainsignal element 1108, the remainder of the signal elements 1107 are ableto communicate with and alter or condition signals emitted from the mainsignal element 1108, in such a way that main signal element 1108'ssignals to and from a control system will indicate the presence (and, insome embodiments) other properties of those remaining signal elements1107. The usefulness of these properties will be better understood fromthe further discussion, below.

Tag 1101 may include an outer coating or shell layer 1151. Layer 1151 ispreferably optimized to survive and ease passage through at least partof a user's upper digestive tract, such as the mouth and esophagus.After ingestion by a consumer user, shell layer 1151 may dissolve, toexpose sub-coatings and surrounding layers. For example, each payloadcompartment, including compartments 1153, 1155, 1157 and 1159, maycomprise its own unique signal element 1107—1127, 1129, 1131 and 1133,respectively—and its own unique payload and coatings. Owing to thedifferent properties of their different coatings, the compartments mayvariably dissolve and open, in any desired order, while maintaining aneffective distance for signal transmission between any of their signalelements (if still held) and main signal element 1108, with the aid of anon-dissolving, or more slowly dissolving, compartment-linking bridge1171, which is attached to and holds each compartment together with mainsignal element 1108, and holds the main signal element. A similarnon-dissolving or more slowly dissolving material may be used toseparate the chambers from one another, where they abut. In someembodiments, signals received by signal elements 1107 may trigger theselective energizing of system-selected signal element(s), to create acatalyzing effect for a reagent, either for selectively dissolving acompartment coating or for affecting a medicinal reaction (such asbetween reagent 1173 and reagent 1174 in compartment 1159), by creatingreaction energy necessary for such chemical reactions, or actuatingmechanisms dependent on such energy. In such embodiments, main signalelement 1108 may serve as a conduit, intermediary or bridge to carrysuch reaction and other actuation activating signals and energy toindividually-selected signal elements 1107. For example, if a physicianor medical technician and/or control system chooses to precisely controlthe moment of deployment of a medicine within a patient's digestivetract (or blood stream, if tag 1101 is ingested) he/she/it may track thelocation of tag 1101 via main signal element 1108, and use main signalelement 1108 to actuate individually-selected compartments for actuationat precisely selected points for deployment of medicine and otheragents.

In some embodiments of the invention, inferential activity data, otherthan from sensor data or background and environmental (base station,beacon, or emanating from other personal activity areas than the user's)signal data, may aid in further defining a user's tracked activitiesand/or consumption data. For example, if a user provides access to hisor her financial or other systematic data relating to food consumption,that data indicating consumption, location attendance, and other suchdata, that data may be applied as a factor by a computer hardware andsoftware control system to an activity and/or consumption assessment,recording and an analysis program also incorporating or applying theother sensed and recorded data and signal types discussed in thisapplication. In some embodiments, a specialized program, with accountsheld by user's and participating venues, may be comprised within thesystem to aid in specialized information sharing to improve activity andconsumption-related data. For example, if both a restaurant andrestaurant patron participates in such a program, the patron's foodconsumption data (for example, from the restaurant billing system) mayshare enable the extraction of nutritional information, for use by thecontrol system in recording and analyzing, and reporting on the patron'sconsumption-relevant data. Other personal activity, consumption andhealth data sensors of a wide variety may also supply such inferentialdata, or direct data, such as waste sensors placed in lavatories, andlocal environmental (e.g., air quality) sensors.

In some embodiments, a control system tracking a user's activities inaccordance with aspects of the present invention may provide feedback,which may be live or real-time feedback, regarding the qualities ofpersonal activity, which may enriched by any of the sources ofactivity-relevant data discussed above. For example, proper speed andform, and/or deviations therefrom, for athletic movements may be assessby the control system using a goal-form library of movement patterns fora matched activity, and relayed to a user or administrator (e.g., coach)on a GUI.

I claim:
 1. A system for determining an activity of a user comprising: ahardware device comprising: at least one infrared imaging sensorconfigured to receive infrared radiation signals emanating from anobject located within a predefined, three-dimensional personal activityspace and not within a space outside of said personal activity space,wherein said at least one sensor is configured to detect object-definingthermal differentials in said 3-dimensional personal activity space; amemory in communication with the device, the memory adapted to store:object information relating to a plurality of potential object typeswith which the user may interact; and activity information relating to aplurality of potential activities the user may undertake with one ormore of the potential object types; a processor in communication withthe device and the memory, the processor configured to: determine afirst position of the object in three-dimensional space at a first time,based on at least some of the radiation; determine a three-dimensionalshape of the object, based on at least some of the radiation; determinean object type of the detected object from the plurality of potentialobject types stored in the memory, based on the determined shape of theobject; and determine the activity of the user from the plurality ofpotential activities stored in the memory, based on the object type andthe first position of the object.
 2. A system according to claim 1:wherein the processor is further configured to determine a firsttemperature of the object; and wherein said determining the object typeis further based on the first temperature of the object.
 3. A systemaccording to claim 2: wherein the processor is further configured todetermine a first temperature of the user; and wherein said determiningthe activity of the user is further based on the first temperature ofthe user.
 4. A system according to claim 1, wherein the processor isfurther configured to determine a second position of the object, at asecond time.
 5. A system according to claim 4: wherein the processor isfurther configured to determine an object movement of the object, basedon the first position and the second position of the object; and whereinsaid determining the activity of the user is further based on the objectmovement.
 6. A system according to claim 5: wherein the processor isfurther configured to: determine a second size of the object; anddetermine a change in size of the object, based on the first size andthe second size; and wherein said determining the activity of the useris further based on the change in size of the object.
 7. A systemaccording to claim 6: wherein the processor is further configured to:determine a second temperature of the user; and determine a change inuser temperature, based on the first and second user temperatures; andwherein said determining the activity of the user is further based onthe change in user temperature.
 8. A system according to claim 7:wherein the object comprises a food; wherein the user activity compriseseating the food; and wherein the processor determines a number ofcalories consumed by the user during eating of the food, based on one ormore of: the movement of the object, the change in size of the objectand the change in user temperature.
 9. A system according to claim 1,wherein the stored object information relating to a plurality ofpotential object types with which the user may interact comprises one ormore of: object size, object shape, object temperature, objecttemperature loss, object temperature loss rate and object movement. 10.The system of claim 1, wherein the processor is further configured toanalyze information related to the radiation differently frominformation related to other radiation that emanates from outside of thepredefined personal activity space.
 11. The system of claim 10, whereinthe processor is further configured to treat said other radiation thatemanates from outside of the predefined personal activity space as anenvironmental condition indicator.
 12. The system of claim 1, whereinthe predefined personal activity space comprises a radius of between 4and 70 inches surrounding the device.
 13. The system of claim 12,wherein the predefined personal activity space is automaticallydetermined by the system based on a time of day.